This paper presents the Korean National Educational Test Benchmark (KoNET), a new benchmark designed to evaluate Multimodal Generative AI Systems using Korean national educational tests. KoNET comprises four exams: the Korean Elementary General Educational Development Test (KoEGED), Middle (KoMGED), High (KoHGED), and College Scholastic Ability Test (KoCSAT). These exams are renowned for their rigorous standards and diverse questions, facilitating a comprehensive analysis of AI performance across different educational levels. By focusing on Korean, KoNET provides insights into model performance in less-explored languages. We assess a range of models - open-source, open-access, and closed APIs - by examining difficulties, subject diversity, and human error rates. The code and dataset builder will be made fully open-sourced at https://github.com/naver-ai/KoNET.

Consider a refugee population coming from country C residing in host country B, with limited or no access to education. The trauma of conflict and displacement, coupled with the difficulty of integration within the host country puts refugee populations at a significant educational disadvantage, so it is worthwhile considering options that could "level the playing field" by providing improved access to education. There is hope that the vast amounts of Open Educational Resources (OER) that are freely available on the internet can play a role in this, in particular in combination with educational platforms like Kolibri. The Kolibri platform aims to provide access to learning opportunities for all and it is particularly suited for the refugee context as the runs-anywhere capabilities of the Kolibri applications allow it to be accessed in computer labs, in the classroom, from phones, and in informal learning centres. Our experience and work with partners like UNHCR have shown that in emergency and crisis contexts, a key bottleneck is the lack of sufficient educational content aligned to the learning goals of the project.